# • 

Serial No. 09/546,213 

IN THE CLAIMS: 

The text of all pending claims are set forth below. Cancelled and withdrawn claims 
are indicated with claim number and status only. The claims as listed below show added text 
with underlining and deleted text with str i k e through . The status of each claim is indicated 
with one of (original), (currently amended), (previously amended), (cancelled), (withdrawn), 
(new), (previously added), (reinstated - formerly claim #), (previously reinstated), (re- 
presented - formerly dependent claim #) or, (previously re-presented). 

Please AMEND the claims in accordance with the following: 



1 . (CURRENTLY AMENDED) A teaching model generating device for image 
processing, in which a subject object has the same or substantially similar shape as that of a 
reference object, and], the device comprising: 

an image processing system with which a current three-dimensional pos i t i on and/or 
posture orientation of the subject object relative to an image pickup device is recognized by 
carrying out pattern matching processing of an image of the subject based on a plurality of 
pre-determined teaching models of the reference object; and 

an image-capture system, in advance of the recognizing, generating and storing the 
plurality of teaching models on the basis of respective image data produced by taking images 
of said reference object from a plurality of directions, wherein one of the reference object and 
afl- said image pickup device is fixed to a movable and positionable part of a-the robot or is 
grasped with a hand of the robot, and said robot is operated for positioning to a plurality of 
different image pickup positions and directions, so that the image data respectively obtained 
at each of said different image pickup positions and direction information indicating the 
respective different direction, is stored as a teaching model. 

2. (CURRENTLY AMENDED) A teaching model generating device for image 
processing, in which a subject object has the same or substantially similar shape as that of a 
reference object, and], the device comprising: 

an image processing system with which a current three-dimensional pos i t i on and/or 
pestwe orientation of the subject object relative to an image pickup device is recognized by 
carrying out pattern matching processing of an image of the subject based on a plurality of 
pre-determined teaching models of the reference object; and 
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an image-capture system, in advance of the recognizing, generating and storing the 
plurality of teaching models on the basis of respective image data produced by taking images 
of said reference object from a plurality of directions, wherein the reference object is fixed to 
a movable part of a first robot or is grasped with a hand of the first robot, and aft -said image 
picl^up moans device is fixed to a movable and positionable part of a second robot or is 
gasped with a hand of the second robot, and any one of or both of said first and second 
robots is operated for positioning to a plurality of different relative image pickup positions and 
directions, so that the image data respectively obtained at each of said different image pickup 
positions is stored as a teaching model. 

3. (PREVIOUSLY PRESENTED) A teaching model generating device according 
to claim 1 , wherein said teaching model is a part of the image data of the reference object. 

4. (CURRENTLY AMENDED) A teaching model generating device according to 
claim 1 , wherein said teaching model i s compos e d o f comprises data obtained by performing 
image processing on the image data of the reference object. 

5. (PREVIOUSLY AMENDED) A teaching model generating device according to 
claim 2, wherein said teaching model is generated for every direction in which said image 
pickup device took the image of said reference object and said teaching model is stored in 
association with information on the direction. 

6. (PREVIOUSLY AMENDED) A teaching model generating device according to 
claim 2, wherein said image pickup device is a camera. 

7. (CURRENTLY AMENDED) A teaching model generating device according to 
claim 2, wherein said image pickup moans device is a three-dimensional visual sensor 
whos e i mag e p i ckup dev i co that measures the-a_distance between the image pickup device 
and a plurality of points on the object. 

8. (CURRENTLY AMENDED) A method for teaching model generation and 
image processing, comprising: 

determining a current three-dimensional pos i t i on and/or postur e orientation of a 
subject object relative to an image pickup device bv carrying out pattern matching processing 
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of an image of the subject based on a plurality of predetermined teaching models of a 
reference object; and 

in advance of the determining, generating and storing the plurality of teaching models 
on the basis of respective image data produced by taking images of said reference object 
from a plurality of directions, wherein one of the reference object and afl- said image pickup 
device is fixed to a movable and positionable part of a robot or is grasped with a hand of the 
robot, and said robot is operated for positioning to a plurality of different image pickup 
positions and directions, so that the image data respectively obtained at each of said image 
pickup positions and direction information indicating the respective different direction, is 
stored as a teaching model. 

9. (CURRENTLY AMENDED) A method of automatic orientation recognition, 
comprising: 

generating and storing a set of images of different relative orientations of a subject, 
the images having been captured by a plurality of robotic operations corresponding to the 
different relative orientations of the subject, and associating with each image information 
indicating its respective relative orientation of the subject; 

after the generating and storing, w ith- from a known current orientation of a robot, 
capturing a current image of a workpiece that has an unknown orientation relative to the 
fobet an image pickup device on the robot before the robot has come into contact with the 
workpiece . where the workpiece has a shape substantially similar to the shape of the subject; 

after the capturing, using pattern matching to match one of the stored images with the 
current image; and 

after the pattern matching, and before the robot has come into contact with the 
workpiece . determining the orientation of the workpiece relative to the fobe ^image pickup 
device on the robot based on the relative orientation information associated with the matched 
stored image, and also based on the known current orientation of the robot. 

1 0. (PREVIOUSLY ADDED) A method according to claim 9, further comprising 
automatically maneuvering the robot to the workpiece based at least on the determined 
orientation of the workpiece relative to the robot. 



1 1 . (PREVIOUSLY ADDED) A method according to claim 9, wherein the 
generating and storing is performed for a plurality of differently shaped subjects, wherein the 
current image includes a plurality of differently shaped workpieces, and wherein the pattern 
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matching further comprises identifying the workpiece from among the plurality of differently 
shaped workpieces using the images and orientation information of the plurality of differently 
shaped subjects. 

12. (CURRENTLY AMENDED) A method of automatic orientation recognition, 
comprising: 

generating and storing a set of images of different relative arrangements of a subject, 
the images having been captured by a plurality of robotic operations corresponding to the 
different relative arrangements, and associating with each image information indicating its 
respective relative arrangement of the subject; 

with a known current arrangement of an image pickup device on a robot, capturing a 
current image of a workpiece with an unknown current arrangement relative to the robot. 
< — where the workpiece has a shape substantially similar to the shape of the subject; 

using pattern matching to match one of the stored images with the current image; and 

determining the current arrongomont orientation of the workpiece relative to the 
image pickup device on the robot based on the relative arrangement information associated 
with the matched stored image, and also based on the known current arrangement of the 
image pickup device on the robot. 

13. (CURRENTLY AMENDED) A method, comprising: 

robotically taking images of a subject with different subject-camera arrangements, 
and associating with each image or data thereof information indicating its subject-camera 
arrangement; then 

taking a current image of a workpiece shaped like the subject; and then before 
picking up the subiect 

determining a current workpiece-camera arrangem e nt orientation bv matching one of 
the images or data thereof with the with-current image, and using predetermined subject- 
camera arrangement information of the matched image to determine the arrang e m e nt 
orientation of the workpiece relative to the camera. 
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